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@ Method and apparatus for determining a quantizing factor for processes involving multiple 
compression/decompression of data. 



0 The invention provides techniques for changing the quantization used in multiple generations of data 
quantization such that the errors incurred in subsequent generations are substantially the same as the error 
incurred in the first generations even though the complexity of the data has been changed. In a preferred 
embodiment, quantizing factors are selected from a preselected finite non-degenerative set of quantizing factors 
provided in the form of arrays of a periodic series of individual quantizer values, wherein a special numerical 
relationship is maintained between corresponding quantizer values in successive arrays. A different quantizing 
factor may be selected for each generation of compression/decompression as required by changing data 
complexity as when performing a layering process during the generations. In another embodiment, an over- 
quantizing factor is chosen large enough to compress the data to a greater extent than that required in the first 
generation, such that sufficient compression still is provided in subsequent generations even though the same 
quantizing factor is used while the complexity of the data is being changed. If for some reason the complexity of 
the data changes faster than expected, it Is necessary to change the quantizing factor to fit the data into the 
allotted space. To moderate the associated increase in noise, the invention technique incudes a dither rounding 
proc ss wherein a psuedo random number sequence in the range of 0...1.0 is selectively added as determined 
by a threshold. The invention also includes estimating a quantizing factor applied in a previous generation of 
image recording if this information is not available explicitly, by distinguishing the peaks and/or valleys of 
histogram. The amplitudes of the peaks and/or valleys represent the number of counts of the respective values 
of frequ ncy coefficients to be quantized. 
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BACKGROUND OF THE INVENTION 

The invention relates to data compression proc sses and particularly to a method for determining 
preferred quantizing factors which limit degradation in image quality generated during multi-generation 
5 compression and decompression cycles to substantially the degradation incurred in the first generation. The 
method also concerns supplying an optimal rounding algorithm and estimating the quantizing factors 
applied in a previous generation if they are not explicitly available. 

Typical television broadcast and post production equipment and processes have used digital technol- 
ogy to take advantage of the power and flexibility inherent in the digital format. The advantages in using the 

70 digital format are particularly evident when applied to the manipulation of images in, for example, post 
production processes during which the information content of the images may be increased, decreased 
and/or rearranged such as is done in the process commonly known as "layering". In such processes, the 
storage and manipulation of television images using digital technology was first performed with random 
acc ss disc recorders. The utility of the digital disc recorders was not so much in their random access 

75 capability, as it was in their ability to re-record images for multiple generations without the loss of fkletity 
caused, for example, when recording multiple generations with analog recorders. 

By way of explanation of the terms "multiple generations" or "multi-generations" as employed in the 
description herein, each sequence of recording and playing back of a video image signal results in the 
reproduction of a copy that is a "generation" removed from the original or preceding video image signal. 

20 Thus, "multi-generations" detines a sequence of selected repetitions of an image signal through a given 
signal process such as, for example, consecutive recarded tape reproductions, post production editing or 
layering processes, etc. In practice, some deterioration of the video image signal occurs during the record 
and reproduce processes because of imperfections in the record and reproduce equipment. This deteriora- 
tion is manifested in the reproduced video images as signal amplitude, frequency and/or phase errors. The 

25 ext nt of deterioration is cumulative and thus increases markedly as the number of record and playback 
sequences, that is, "generations" experienced by the video image signal increases. Even In the absence of 
layering, a few record/playback sequences of an analog video image through imperfect or misadjusted 
equipment, such as may occur during electronic editing processes, produce severe deterioration in the final 
generation of the video image signal obtained. 

30 It is well known that the size and cost of any present or future digital recorder is directiy related to its 
data rate and storage capacity. Accordingly, there are increasing numbers of applications in which there is a 
strong incentive to reduce these requirements as, for example, by using some form of data compression. 
This is particularly true for digital video tape recorders, disc recorders and other high density television and 
data recorders. Various configurations of these recorders commonly are used in television post production 

35 processes, where 10 to 20 generations of. for example, video image data are common and more than 50 
generations are occasional requirements. To be acceptable, a compression algorithm used in these 
recorders must meet the same multi-generation requirements as are imp>osed on D-1 component and D-2 
composite color video tape recording standards, that is, a 4.5 image rating on the CCIR 600 five point scale. 
In the event that image data is compressed before being recorded by a digital disc or an analog or 

40 digital tape recorder, it is well known that the process experiences an inherent initial quantization error 
which is generally a one time en'or occurrence. In the absence of uncorrectable recorder errors, initial 
quantization errors generally do not get worse with subsequent multiple generations of compression and 
decompression. This Is only true, however, if there is no additional processing of the television image 
between the generations, image processing such as the process of Image "layering" mentioned above, 

45 wherein additional image data are superimposed on, or undesired image data are removed from, an existing 
video image, introduces quantization roundoff errors, otherwise known as rounding errors. The rounding 
errors are the inherent distortion introduced into the signal by the quantization process, wherein a range of 
values Is divided into a finite number of smaller sut>-ranges. each of which is represented by an assigned or 
"quantized" value within the sub-range. The introduction of rounding errors in subsequent generations after 

50 the first generation, will degrade the signal-to-noise ratio in some way with each generation. Fortunately it is 
xtremely rare for any one area of an Image to be processed more than a few times even if it is re-recorded 
very many times. 

in the case of compression and decompression cycles an additional requlrem nt is tt?at the compres- 
sion ratio, that is, the quantizing factor, is constant for each ar a of the Image, for ach generation. In order 
55 to achi ve some worthwhil compression ratio, most compression algorithms do not compress all areas of 
the image to the same degre . Busy areas in the picture produc more data than quiet areas and thus a 
coarser quantizing factor generally is applied to the data in busy areas. Accordingly, in typical data 
compression process s, the average compression parameters are selected and/or adjusted to provid the 

3 
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desired total recorded data per image. That is, in video image compression applications it gen rally is 
desirable to compress video images to a particular data block size (in bits) or average data rat (in bits per 
second). The quantizing factor, other parameters being constant, is chosen to yield the desired compressed 
data block size or average data rate that will just fit the data into a desired data block length, and/or into an 

5 allotted recording space on the disc or tape. To this end. some compression algorithms adjust their 
parameters dynamically from block to block of data. Others adjust a single set of parameters each 
generation for use over a relatively large area of the image, up to the entire image. 

It has been determined that if the same image is compressed and decompressed many generations, it 
will not suffer any substantial degradation beyond the first generation, particularly if the same quantizing 

10 factor is used for each area. However, if the image is changed in some way between generations, that is, if 
an image layering process is performed, and the usual different optimum quantizing factors which precisely 
fit the compressed data into the allotted space are used to achieve the same compression in each 
generation, the complexities of the conditions can lead to a rapid degradation in image quality. In addition, 
the normal rounding technique of adding a constant 0.5 and truncating the fractional part, accelerates the 

76 degradation. 

It follows that it would be highly desirable to provide a compression/decompression technique for 
accomplishing multiple generation image layering without degrading image quality, wherein each generation 
introduces an increased or decreased layer of data over a portion of the existing image whereby the layer is 
more or less complex than the portion of the image it replaces. Such multiple layering processing results in 

20 slightiy more, or slightiy less, compression being required with each generation. The technique should 
compenscile for the increase or decrease in compression required, while still maintaining the optimal image 
fidelity throughout the successive generations after the first. 

The present invention overcomes the shortcomings of typical prior art, by providing techniques and 
associated embodiments for compressing and decompressing Images through multiple generations while 

2S limiting the image degradation to little more than that which inherentiy is suffered in the first generation of 
compression. That is. the invention technique provides for changing quantization in multiple generations of 
quantization in which the image complexity may be varied, such that the errors after the final quantization 
generation are approximately the same as the errors generated in the first quantization. 

In the preferred embodiments, the invention provides for the selection of an "over-quantizing" factor, a 

30 finit "non-degenerative set of quantizing" factors, and/or a "dither rounding" algorithm, which minimize 
degradation in image quality typically Incurred as a result of performing a data layering process during 
multi-generation compression and decompression cycles. 

According to one aspect of the invention, a method of selecting quantizing factors which limits the 
quantizing noise introduced during a corresponding data quantizing and dequantizing process when 

35 performing multi-generations of data quantizing and dequantizing, comprises determining quantizing factors 
for first and subsequent generations which limit tiie degradation in the quality of the data typically caused 
by variations in the data being introduced in subsequent generations to substantially the degradation 
incurred in the quantizing and dequantizing process in the first generation. 

The step of determining may include estimating an optimum quantizing factor which compresses the 

40 data sufficientiy to fit the data into an allotted data space; selecting an over-quantizing factor which is larger 
than said optimum quantizing factor to substantially over-compress the data such that the data does not fill 
the allotted data space; and using the same larger over-quantizing factor in subsequent compression 
processes during the conresponding successive multi-generations of data quantizing and dequantizing. 

Where data represents an image and the complexity of the image data is changed in selected 

45 generations, the step of selecting may include providing excess compression by selecting an over- 
quantizing factor as a function of the expected cumulative change in image data complexity performed in 
subsequent generations. 

Th method may include supplying a trial array of quantizer values; detenmining whether the trial array 
of quantizer values fits the image data into the allotted data space; performing any necessary iterations on 
50 the quantizer values until the image data fits into the alk)tted data space; identifying said over-quantizing 
factor which substantially over-compresses the image data in response to said iterations; selecting an array 
of quantizer values corresponding to th over-quantizing factors which over-compress s th image data; 
and quantizing th image data in r sponse to the selected array of quantizer values which over-compress 
the image data. 

65 The method may further include transforming the data into selected transform coefficients prior to over- 
compressing the data; changing the larger over-quantizing factor in one of the successive multi-generations 
of data processing; and applying a pseudo random numfc»er sequence to selected transform coefficients 
which exceed a selected threshold, to randomly round off the coefficients. 
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The mdthod may further include generating the pseudo random number sequence within a range of 0 
to 1.0 and with a pre-selected energy spectrum, for us in the step of applying. 

Where a generation subsequent to a first generation is to be compressed and the over-quantizing factor 
is not known, the method may include transforming the data into respective tr|mform coefficients prior to 

5 compressing the data; generating a histogram of selected coefficients of the respective transform coeffi- 
cients; and detecting the peaks or valleys of the histogram to determine the quantizing factor used 
previously. The step of generating a histogram may comprise counting the occurrences of the amplitudes of 
the selected coefficients; and the step of detecting the peal<s or valleys may include determining the 
amplitude which has the largest or smallest number, respectively, of occurrences. Valleys which occur in 

70 the histogram half way between the pealcs may be detected to refine any ambiguity in detecting the peaks 
or the separation between the peaks. 

The step of detecting may include providing a fundamental frequency signal indicative of the peak 
separation; and scanning the fundamental frequency signal to provide the largest non-zero order peak 
commensurate with the quantizing factor. 

75 The step of determining may include selecting a first quantizing factor which would just fit the 
compressed data into the allotted data space; selecting a second quantizing factor which is larger than the 
first quantizing factor; compressing the data in response to the second quantizing factor; and using the 
same larger second quantizing factor in subsequent compression processes performed during the cor- 
responding successive multi-generations of data quantizing and dequantizing. 

20 The step of determining may include providing a finite non-degenerative set of quantizing factors; 
selecting a quantizing factor from said non-degenerative set which provides sufficient compression to fit tiie 
compressed data into the allotted data space; and repeating the step of selecting for each subsequent 
multi-generation of data processing. The quantizing factors may correspond to multiple arrays of quantizer 
values, wh^ein corresponding quantizer values in successive arrays have a predetermined numerical 

25 relationshipyrThe numerical relationship may be of the order of three and the non-degenerative set of 
quantizing factors may be linesur. 

If the image data are in the form of transform coefficients, the linear non-degenerative set of quantizing 
factors may? be derived from the relationship q value = K* (3**n). where K is a constant for any one 
transform coefficient across the set of quantizing factors, and n is any positive integer including zero. The 

30 quantizing (actors may be an approximation of the non-degenerative set of quantizing factors. 

Howeve^^T the non-degenerative set of quantizing factors may be non-linear and the numerical relation- 
ship may be less than three. 

The image data may be in the form of a data array of selected transform values, and different quantizer 
values to different transform values of a data array to provide a selected average quantization. The 

35 transform values of the data array may be ordered by their significance, and coarser quantization may be 
applied to the less significant transform values. 

A plurality of lookup tables corresponding to the non-degenerative multiple arrays of quantizer values 
may be stored; and so that the lookup table which properly compresses the image data may be selected to 
fit the data readily into the allotted data space. 

40 The method may include a decompression process including forwarding, atong with the compressed 
image data, a signal which identifies the multiple arrays of quantizer values used in the compression 
process, for use in the decompression process. 

The method may include supplying a trial array of quantizer values; determining whether the trial array 
of quantizer values fits the image data into the allotted data space; performing any necessary iterations on 

45 the quantizer values until the image data fits into the allotted data space; identifying a quantizing factor from 
said non-degenerative set which provides sufficient compression to provide said image data fit; selecting an 
array of quantizer values from said non-degenerative set which corresponds to said quantizing factor; and 
quantizing the image data in response to the selected array of quantizer values. 

The method may include transforming the data into selected arrays of transform values; providing a 

50 plurality of arrays of quantizer values wherein each array has a quantizing factor commensurate with an 
average of the quantizer values; selecting a quantizing factor from a plurality of lookup tables which 
provides sufficient compression to fit the data, after compression, into the allotted data space; quantizing 
the arrays of transform values in response to the selected quantizing factor; and rep ating the at>ove steps 
for subs quent data compressed during each of said multi-generations. A signal which Identifies the 

55 quantizing factors used in the compr sslon proc ss may be stored together with the compressed data 
where th compressed data is decompressed in a decompression process, the compr ssed data may be 
recovered along with th signal identifying tiie quantizing factors used in the compresston process; and th 
compr ssed data may be decompr ssed using to a lookup tabi s lected by the identifying signal from a 
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plurality of lookup tables corresponding to the lookup tables used In the compression process. 

In another aspect the invention provides a system for quantizing and dequantizing image data, 
apparatus for selecting quantizing factors which limit the amount of distortion incurred by the image data In 
subsequent generations due to variations of the image data being Introduced during at least some of 
5 subsequent mutti-generations of quantizing and dequantizing, said apparatus being characterised by means 
for selecting quantizing factors which limit the degradation in image quality by variations in the image data 
being introduced in subsequent generations to substantially the degradation incurred in the first generation. 

The apparatus may further comprise means for transforming the image into selected arrays of transform 
values; means receiving the transform values for selecting an over-quantizing factor which over-compresses 

70 the image data such that the data does not fill an allotted data space; and means receiving the selected 
arrays of transform values for quantizing the transform values in response to the over-quantizing factor, to 
provide the over-compressed image data; and the quantizing means may apply the same over-quantizing 
factor to transform values in the successive multi-generations. 

Alternatively or additionally the apparatus may comprise means for transforming the image data into 

76 selected arrays of transform values; means receiving the transform values for estimating a quantizing factor 
for properly fitting the data when compressed into an allotted data, space; means for providing a 
predetermined finite non-degenerative set of quantizing factors in the form of arrays of quantizer values; 
means storing the arrays of quantizer values for supplying an array commensurate with the estimated 
quantizing factor in response to the estimating means; and means for compressing an array of transform 

20 values in response to a respective array of quantizer values. 

According to a further aspect of the invention, apparatus for selecting quantizing factors for compress- 
ing image data into allotted data spaces through successive multi-generations of image data processing, 
during which the complexity of the Image data is changed, comprises means for varying the complexity of 
the image data in at least one of the multi-generations; means for transforming the image data into selected 

25 arrays of transform coefficients in each of the multi-generations; means receiving the transform coefficients 
for selecting quantizing factors which limit the degradation incurred by the image data in the successive 
multi-generations to the degradation inherent in the compression process during the first generation, while 
providing sufficient compression to fit the compressed data into the allotted data spaces In each of the 
multi-generations; and means receiving the selected arrays of transform coefficients for quantizing the 

30 transform coefficients of each of the multi-generations in response to the respective selected quantizing 
factor. 

The selecting means may provide an over-quantizing factor which substantially over-compresses the 
image data such that the data does not fill an allotted data space, and wherein the selecting means further 
provides the same over-quantizing factor through the successive multi-generations of image data process- 
35 ing. 

The selecting means may include means for providing a trial anray of quantizer values which 
correspond to a mid-range quantizing factor for an image of average image complexity; means for storing a 
preselected number of arrays of selectively increasing quantizer values; and means responsive to the trial 
array for deriving said over-quantizing factor in the form of one of said stored arrays of quantizer values. 
4o The deriving means may include quantizer circuit means for compressing the transform coefficients into 
a s lected stream of data bits; and means for identifying the number of compressed data bits in the stream. 
Th storing means may include a lookup table circuit containing said stored arrays of quantizer values, and 
responsive to the identifying means, for providing one of the arrays of quantizer values as said over- 
quantizing factor. 

45 The apparatus may further comprise means for producing a histogram of selected arrays of the 
transform coefficients; and means for detecting the peaks or valleys of the histogram to determine a 
quantizing factor used in a previous generation. 

The over-quantizing factor may be changed to another quantizing factor and may be provided for 
applying a psuedo random number sequence to the arrays of transform coefficients which exceed a 
so sel ct d threshold, to round off the coefficients randomly. 

The selecting means means for providing a finite non-degenerative set of quantizing factors; and means 
for selecting a quantizing factor from the non-degen rativ s t which provid s sufficient compression to fit 
the compressed Image data into an allotted data space of a r spectlve generation; said s.electing means 
thereafter selecting a quantizing factor from th non-d generative set In response to the change in 
65 complexity of the image data in each of the successive multi-generations. 

The apparatus may include means for identifying the array of quantizer values used to compress the 
respective array of transform values; means for recovering the identity of the respective array of quantizer 
values along with the corresponding compressed image data; and means for decompressing the com- 
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pressed image data in response to the respectiv identified array of quantizer values. 

A further aspect of the invention consists of a method for rounding a transform coefficient in a 
compression process, comprising the steps of: generating a pseudo random number sequence; adding the 
pseudo random number sequence to the transform coefficient; and truncating any fractional part of the 
5 summation to leave only an integer part thereof as the rounded transform coefficient. 

This method may include providing a preselected threshold; and adding the pseudo random number 
sequence to transform coefficients which are greater than the preselected threshold. The threshold may be 
in the range of ±1 to ±3, and the psuedo random number sequence may be within a range of 0 to 1 .0 with a 
preselected energy spectrum distribution. 
10 The method may include a decompression process for the previously compressed transform coefficient, 
comprising: identifying the slart of the pseudo random number sequence; adding a constant such as 0.5 to 
the previously compressed data; and subtracting the pseudo random number sequence from the previously 
compressed data in response to the start identification. The constant may be added to, and the pseudo 
random number sequence may be subtracted from from previously compressed data which are greater than 
IS the preselected threshold; 

The invention also provides apparatus for rounding a transform coefficient in a compression process, 
comprising: means for generating a pseudo random number sequence; means for adding the pseudo 
random numlDer sequence to the transform coefficient; and means for truncating any fractional part of the 
summation to leave only an integer part as the rounded transform coefficient. The apparatus may have 
20 means for performing the steps of the corresponding method. 

A further aspect of the invention concerns method for determining a quantizing factor used in 
compressing image data in a previous generation of multi-generations, comprising transforming the image 
data into corresponding transform values; generating a histogram formed of selected values of the transform 
values; an0"^distinguishing the peaks or valleys of the histogram which are indicative of the quantizing factor 
25 used previously, so that the same quantizing factor is used in the next generation. 

The steps of generating and distinguishing may include plotting the number of occurrences of selected 
amplitudesn^of the transform values; and determining the amplitude which has the largest number of 
occurrences to determine the quantizing factor. 

Appar^us for determining a quantizing factor used in a previous generation of image data compression, 
30 comprising^means for transforming the image data into corresponding transform values; means receiving 
the transform vcilues for determining the number of occurrences of arnplitudes of selected transform values; 
and means-responsive to the determining means for distinguishing the amplitude which as the largest or the 
smallest number of occurrences indicative of the previous quantizing factors. 

This apparatus may include counter means for counting the number of occurrences of the amplitudes of 
• 35 selected transform values; and means for generating a histogram of the amplitude occurrences. 

The distinguishing means may include means for detecting the peaks or valleys of the histogram 
indicative of the quantizing factor; the detecting means may include auto correlation means for providing a 
fundamental frequency signal indicative of the peak separation; and first order peak estimator means for 
scanning the fundamental frequency signal for the largest non-zero order peak commensurate with the 
40 quantizing factor. 

More particularly, in a basic concept of the invention technique, a trial quantizing factor first is selected 
by experience as a mid-range value for an image of average information complexity. After additional 
iterations if necessary, in which the trial quantizing factor is refined, an over-quantizing factor is chosen 
whose value is large enough to compress the image to a greater extent than that required in the first 

45 generation. That is. the over-quantizing factor is sufficiently large enough that sufficient compression still is 
provided in subsequent generations even though the same over-quantizing factor is used, white the 
complexity of the Image is being increased by layering processes during the multiple generations. More 
particularly, the over-compression selected, for example, in the first generation, is a function of the expected 
cumulative increase in image complexity by any successive layering operations performed during subset 

50 quent generations. It follows that the quantizing factor need not be changed in subsequent generations even 
though there is an increase In image complexity, due to the fact that a larger over-quantizing factor was 
s looted for the first generation than would b r quired for ideal quantization if only a single generation 
were performed. 

If for some reason the complexity of the image due to lay ring increases faster than xpected. wher by 
55 the number of bits or the data rate of the compressed image becomes unacceptable, it becom s necessary 
to increase the quantizing factor in order to fit the image into the availabi space. Also, it may be necessary 
to decrease th quantizing factor in the event that the image complexity decreases by a significant amount. 
If such a change in tiie quantizing factor is unavoidable, the invention technique includes an optimal 
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rounding algorithm, or "dither rounding** technique where, Instead of adding a constant 0.5 before truncating 
in the rounding process as is commonly done at present in compression processes, random numbers with, 
for example, a generally uniformly distributed energy spectrum in the range 0...1.0. are selectively add d as 
determined by a threshold. In this way, any image degrading rounding sequences are broken up, although 

5 at the expense of additional random errors. However, the distribution of the random numbers may be 
selected to minimize the visibility of the errors. 

In a preferred embodiment of the Invention, the quantizing factor may be selected from the predefined 
finite non-degenerative set of quantizing factors of previous mention. A trial quantizing factor first is 
estimated and, via additional iterations if necessary, a quantizing factor of the non-degenerative set which 

10 comfortably fits the compressed data into the allotted data block length and/or recording space, then is 
selected for the first generation. In subsequent generations of compression/decompression with layering of 
additional Image data, different respective quantizing factors of the non-degenerative set, each of which 
readily fits the compressed data into the allotted block length and/or recording space, maybe selected with 
no additional degradation in the image quality in the subsequent generations. By way of example, a finite 

16 non-degenerative set of quantizing factors are provided in the form of "arrays" of a periodic series of 
individual quantizing values, herein termed "quantizer values**, wherein a special numerical relationship is 
maintained between corresponding quantizer values in different arrays. It has been found that the preferred 
numerical relationship between corresponding quantizer values of the non-degenerative set of quantizing 
factors is a ratio of the order of three, although other numerical relationships are possible. For example, for 

20 a linear non-degenerative set of quantizing factors the preferred numerical relationship is the ratio of the 
order of three. However, a non-linear non-degenerative set of quantizing factors does not require a ratio of 
three but still must meet other criteria imposed on the non-degenerative technique, as described herein. 
Further, it Is to be understood that although the ratio of three is preferred, any number in a given range 
center d about three is equally well suited. For example, a ratio of 3.005, 3.01 or 3.1. or of 2.995, 2.99 or 

25 2.9. etc. may be used with only correspondingly slightly increased degradation in picture quality. 

In the example described herein, a quantizing factor is fully described by an 8x8 array of individual 
quantizer values which, in the compression process, are applied to an 8x8 array of discrete cosine 
transform coefficients. The coefficients, in turn, represent an 8x8 group of pixels taken from the video 
image. By way of example only, the transform coefficients are depicted herein as comprising 12 bit digital 

30 sampi s generated by a transform process from respective 8 bit samples of the video image. 

A further feature of the invention Includes estimating a quantizing factor applied in a previous generation 
of image recording, where this information is not available explicitly. The latter feature consists of finding 
the separation between peaks and/or valleys in a histogram, wherein the amplitudes of the peaks and/or 
valleys represent the number of counts of the respective values of frequency coefficients to be quantized. 

35 The separation between peaks is the reciprocal of the desired multiplicative quantizer if a quantizer of less 
than 1 is used, and is equal to the dividing quantizer if a quantizer of greater than 1 is used. 

in the example herein, quantization Is applied to frequency coefficients after taking a discrete cosine 
transform (DOT), but the technique is applicable to many other compression algorithms using other 
transformations which at some stage involve quantization. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a functional block diagram illustrating a data record/playback process in which 
compr ssion/decompression processes also are performed, wherein the entire cycle of compression, 
45 recording, playback and decompression constitutes one generation of a multi-generation process as 
discussed herein relative to the invention. 

FIG. 2 is a block diagram of a data compression and decompression system illustrating an environment 
In which the present invention is used. 

FIG. 3 is a block diagram showing in further detail the Q estimator circuits of the system of FIG. 2. 
60 FIG. 4 is a graph illustrating a histogram of the measured outputs of the first five AC coefficients 
generated In a computer simulation of a data compression process used to compress a boat scene. 

FIG. 5 Is a block diagram illustrating an alternative embodiment of the previous Q estimator circuit of 
FIG. 3. 

FIG. 6 is a functional block diagram Illustrating a prior art rounding technique us d to hide contours 
55 when performing data quantization. 

FIGs. 7 and 8 are functional block diagrams illustrating dither rounding and recovery for compression 
and decompression processes, respectively. In accordance with the invention. 

FIG. 9 is a graph qualitatively comparing RMS errors generated during multi-generation data compres- 



8 



EP 0 509 576 A2 



slon processes when using prior art techniques and when using the invention techniques described her In. 
DESCRiPTION OF THE PREFERRED Eiy/IBQDIMENTS 

5 In a data processing operation such as data coaipression, quantizing conventionally is perfornned by 
effectively multiplying each coefficient by a quantizer which is less than 1 . (or by effectively dividing each 
coefficient by a quantizer which is greater than 1). then rounding the result by the addition of 0.5 and 
truncating the fractional part of the summation. It has been determined experimentally that if the complexity 
of the data being processed is increased or decreased during multiple generations, and if the quantizer is 

10 changed from generation to generation, the resulting errors due to rounding and truncation grow at an 
unacceptably large rate. Accordingly, the invention proposes limiting the choice of quantizing factors to (1) 
an over-quantizing value which then is used through all subsequent generations, and (2) quantizer values 
selected from a non-degenerative set of quantizing factors, wherein linear values therein have a preselected 
numerical relationship between corresponding values in different arrays, e.g.. of the order of three. In the 

IS event the first mentioned over-quantizing technique is applied in generations succeeding the first, and the 
previous quantizing factor is not available explicitly, the invention estimates the previous quantizing factor 
from histograms of unquantized transform coefficients. In a further embodiment, in the event an over- 
quantizing factor must be changed in a subsequent generation, the invention employs a dither rounding 
algorithm which minimizes the growth of the roundoff errors due to quantization in the corresponding 

20 subsequent generation. 

FIG. 1 illustrates in functional block diagram a complete "generation" of a record/playback process 
using the further processes of data compression and decompression, in which the invention techniques are 
employed to circumvent problems generated when performing data "layering" during multiple generations 
of the recording/playback processes. As previously mentioned, layering is a process v^diereby additional 

25 image dataVis added to (or removed from) an existing image during consecutive recording and playback 
cycles, and which accordingly increases or decreases image complexity. Thus, in FIG. 1 image data 
corresponding, for example, to a video image, are applied via an input bus 10 to a means 7 for 
compressing and encoding the data, whereupon the compressed/encoded data are supplied in a suitable 
format to data recorder/playback apparatus, or to a transmission channel or other utilization apparatus, as 

30 depicted via the block 8. The resulting compressed image data subsequently may be supplied to means 9 
for decoding and decompressing the data, whereupon the decompressed image data corresponding to ihe 
original video image are provided on an output bus 12 to complete a "generation" of data processing. The 
image data on output bus 12 may be applied to a layering means 13. whose output subsequentiy may be 
applied to the input bus 10 to form a generation loop which includes a layering process. 

35 As maybe seen, the apparatus loop of FIG. 1 illustrates one record/playback generation commonly 
performed by a video tape recorder or other recording apparatus. The loop also depicts the processes of 
compressing/encoding and tiie inverse processes of decoding/decompressing the data, as well as the 
process of layering of data on the original image, as an integral part of the complete generation. It follows 
that tiie passage of additional cycles of the same data through the apparatus loop of FIG. 1 such as 

40 employed, for example, in television post production facilities, constitutes the multi-generation process 
referred to in the description herein. As well known in the art, the layering processes may be perfonmed, for 
example, by apparatus such as video switchers, digital optics data manipulating apparatus and/or graphic 
art systems. 

Although the invention is described herein relative to video image data, it is to be understood that other 
45 typ s of data and respective processing systems may utilize the invention techniques. For example, tiie 
data may be a stream of data bits which are supplied to a transmission channel for transmission to and 
from a preselected utilization apparatus such as a satellite, etc., wherein the compressed data is fitted into a 
stream of data block lengths or have a preselected data rate, rather than be recorded in allotted spaces on 
magnetic tapes or disks, 

50 In addition, to facilitate the description herein, the invention is descritjed by way of example only, in 
terms of tiie standards imposed by the Joint Photographic Experts Group (JPEG), which concem technical 
descriptions of, for example, encoding and decoding algorithms and th encoded data format. In th 
standards. 8x8 blocks of pixel data are transformed via a sultabi transform such as a discrete cosine 
transform (DCT). into respective 8x8 an-ays of OCT coefficients. The 8x8 blocks of samples of pix I data ar 

55 obtained by dividing the input sample array into contiguous 8x8 blocks of pixels which, in turn, are derived 
from a subdivision of, for example, a luminance component (Y), and chrominance components (R-Y, B-Y) 
image, with vertical resolution of 576 rows and horizontal resolution of 720 columns of the Y component, or 
360 columns of the R-Y. B-Y components. The 8x8 anray of DCT coefficients is ordered with the DC 
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component in the upper left comer, with increasing horizontal "frequencies" to the right of the array and 
with increasing vertical "fr quencles" towards the bottom of the array. 

FIG. 2 illustrates in block diagram a data compression/decompression system modified in accordance 
with the present invention, for compressing and encoding video image data corresponding, for example, to 
5 the image data signal of FIG. 1, and also for decoding and decompressing the previously compressed and 
encoded data. The video image data are formed of a serial stream of 8 bit digital samples of the 8x8 bloci<s 
of pixel data recommended, for example, by the JPEG standard of previous mention, and are supplied, via 
the input bus 10, to a transform process herein illustrated as a discrete cosine transform (DOT) circuit 14 by 
way of example only. It is to be understood that other transform processes and other block sizes may be 

70 used instead. The resulting 8x8 array of transform coefficients is supplied as 12 bit samples from the DCT 
circuit 14 to a delay circuit 16 and thence to a quantizer circuit 18. The delay circuit 16 provides a time 
delay equivalent to the time required to estimate and select a quantizing factor via a parallel channel further 
described below. As shown, the quantizer circuit 18 typically includes a circuit 17 for effectively dividing the 
transform coefficients by selected quantizer values, and a circuit 19 for rounding (truncating) the resulting 

76 values of the division process. The quantizer circuit 18 is coupled to an entropy encoder circuit 20 which is 
illustrated herein by way of example only, as a Huffman encoder. It is to be understood that other equivalent 
encoding processes may be used instead. The signal is provided on an output bus 22 as a 
compressed/encoded video data signal, which is in a suitable format of 8 bit digital samples for recording 
on tape or disc, or for transmission to other utilization apparatus. The output signal from the encoder circuit 

20 20 may be a serial stream of digital samples of varying numbers of bits. A typical system for providing the 
functions of the compression/encoder circuits 14. 18, 20 may be found in the application USSN -07/560,606, 
filed July 31,1990. and entitied Data Compression Using A Feedforward Quantization Estimator, assigned to 
the same assignee as this application, and incorporated herein by reference. 

In accordance with the invention, the compression/decompression system also supplies the output of 

25 the DCT circuit 14 to a "required" Q estimator circuit 24 as well as to a "previous" Q estimator circuit 26. 
As implied by the tities, the circuit 24 provides means for determining the quantizing factors for a 
subsequent compression/decompression process, and the circuit 26 provides means for determining 
unknown quantizing factors used in a previous compression/decompression process, as further described in 
FIQs. 3-5. For simplifying the description, the letter "Q" is used herein at times as a convenient 

30 identification for an array of individual quantizer values, one for each coefficient to be quantized. The 
outputs of the two estimator circuits 24. 26 are supplied for example, as 7 bit digital samples, to a Q 
selector 28 whose output, in turn, enables one Q factor from a Q lookup table circuit 27. In the JPEG 
standard, each array may contain 8x8 or 64 individual quantizer values. The table circuit 27 contains a 
select d number of arrays of quantizer values, and for the 7 bit input shown here contains 128 arrays of 64 

35 quantizer values. The quantizer values corresponding to the selected array are supplied to the quantizer 
circuit 18 via a bus 25, and determine the compression ratio resulting from the compression process. More 
particularly, Q selector 28 and table circuit 27 supply digital values corresponding to the quantizer values to 
be used by the divider circuit 17 in the compression process. 

Thus, in a first generation of a record/playback process, the transform coefficients from the DCT circuit 

40 14 are supplied to the required Q estimator circuit 24, which also receives a trial array of quantizer values 
supplied via a trial Q bus 30. The trial array of quantizer values is a mid-range value selected by experience 
for an image of average information complexity. The required Q estimator circuit 24 generates a signal 
indicative of how much quantization is required to provide the number of bits of compressed data which just 
fills the allotted space in the data block to be recorded, or which provides the desired data block length or 

45 average data rate in a serial stream of data samples. More particulariy, the Q estimator circuit 24 in turn 
provides, to the Q selector 28. a Q factor identifier signal which identifies the array which will properiy 
compress the video image data to the preselected extent needed for the particular application. The Q 
lookup table circuit 27 then supplies the individual quantizer values of the selected array to the quantizer 
circuit 18. The preferred embodiment herein describes the use of lookup tables to provide Individual 

50 quantizers, but a combination of lookup tables and computation is equally applicable. For example, if i and j 
repres nt respectively the horizontal row and vertical column numbers of an array, and k represents the Q 
factor identifier number, then an individual quantizer value q may be computed from an equation such as 
the following: q q = 3 to the power of <lnteger((i+j)/k)). A typical system for providing the functions of the 
requir d Q estimator circuit 24 may be found In the application USSN 07/560.606 of previous mention. 

55 In a next generation of a multi-generation process in which layering may hav increased or decreased 
the image complexity, the transform coefficients corresponding to the new video image data ar supplied 
from the DCT circuit 14 to th previous Q estimator circuit 26 as well as to the required Q estimator circuit 
24 as in the previous generation. The previous Q estimator circuit 26, supplies a signal indicative of how 
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much quantization, if any, was used previously on the incoming video image data. The input signal may be 
that supplied in a second or later generation, or may be an unl<nown signal recovered from a new tape 
wh rein the data might or might not hav been compr ssed. The new Q factor identifier signal from the 
previous Q estimator circuit 26 also is supplied to the Q selector 28 along with the output from the required 

5 Q estimator circuit 24. Thus, after the first generation, the signal supplied by the Q selector 28 is based not 
only on the estimate of what Q factor is required, but also on what Q factor was used in the compression 
process of the last generation. That is. the Q selector 28 selects one of the values from the two estimator 
circuits 24, 26. The Q factor selected is the one which provides the greater compression, unless the Q 
factor from the required Q estimator 24 provides significantiy less compression (typically a factor of five) 

TO than the Q factor from the previous Q estimator 26. In this situation, the complexity of the image has 
decreased so significantiy that it would i>e impractical to not lower accordingly the compression ratio, and 
thus the Q factor from the required Q estimator 24 is selected. As in the previous generation, the 
appropriate individual quantizer values generated on bus 25 via the Q lookup table circuit 27, are supplied 
to the quantizer circuit 18 and are applied to the video image data signal which has been suitably delayed 

75 by th delay circuit 16. The compressed and encoded video Image data then are supplied via the output 
bus 22 to a recorder for subsequent recording, to a transmission channel for other utilization, or to other 
utilizing means, as depicted previously via the block 8 In FIG. 1 . 

The identities of the Q factors, or of the individual quantizer values, used in the compression process 
also are suitably recorded or transmitted as overhead along with the compressed video image data, as 

20 depicted via the line 32. The Q factors or quantizer values used in the compression process thus are 
available for use in a subsequent decompression process, which is another condition of the JPEG standard. 

In a subsequent decompression process when the previously compressed and recorded video image 
data is recovered from an outside source such as the tape recorder of previous mention, the compressed 
image details supplied via a bus 34 to a decoder circuit 36. In addition, as depicted via a bus 38. a signal 

25 identifying:;tiie Q factors or quantizer values used in the previous compression process also is recovered as 
the Q factor identifier signal which was previously inserted as overhead in the data signal. The identifier 
signal is supplied to a Q lookup table circuit 29 similar to the Q lookup table circuit 27. wherein the former 
supplies the individual quantizer values of the same array previously used in the compression process, to a 
dequantizer circuit 40. The dequantizer circuit 40 includes a circuit 39 for nriultiplying and a circuit 41 for 

30 rounding, "Which perfomr) the inverse processes of the quantizing process performed by circuit 18, in 
generally conventional fashion. The decoder circuit 36 decodes the recovered image data. and supplies the 
decoded data to the dequantizer circuit 40. The resulting transform coefficients are supplied, for example, 
as 12 bit digital samples to an inverse transform circuit 42. The latter circuit supplies a video image data 
signal on the output bus 12, which signal is a reconstruction of the original video image data signal on input 

35 bus 10, with some degeneration in the signal due to the rounding process inherent in the reconstruction part 
of the compression/decompression processes. 

Various manufacturers supply data, compression/decompression integrated chips that include the DCT 
circuit 14. the quantizer circuit 18 and the entropy encoder circuit 20 within a single chip. Thus, since this 
and similar chips are readily available, a practical implementation of the circuit of FIG. 2, including the 

40 required and previous Q estimator circuits 24, 26. is iliusti^ated in FIG. 3. Like components are similarly 
numbered, witii a prime symbol added to components in the integrated chips of FIG. 3 which might not be 
precisely the same but are in essence equivalent. 

As in FIG. 2, tiie image data are supplied via the bus 10 to the delay 16. and thence to an integrated 
compression chip 51 containing a DCT circuit 14', a quantizer circuit 18' and an encoder circuit 20'. The 

45 quantizer circuit 18' is supplied with the individual quantizer values via the bus 25, and the encoder circuit 
20* supplies the compressed/encoded signal on the output bus 22. In like fashion, the required Q estimator 
circuit 24' includes an integrated compression chip 50 which includes the OCT circuit 14', the quantizer 
circuit 18' and the encoder circuit 20'. As in FIG. 2. the trial array of quantizer values is supplied to the 
quantizer circuit 18* via the bus 30. The encoder 20' of the chip 50 supplies a digital data stream 

so corresponding to the actual number of data bits generated for a given data block to be recorded after the 
data is compressed, to counter means 52 of the required Q estimator circuit 24*. The output of the counter 
means 52 comprises the number of data bits count d per data block, and Is supplied to a lookup tabi 
circuit 54. The lookup table In circuit 54 stores a Q factor Identifier for each of a selected number of rang s 
of possible count results from the trial compression carried out in th chip 50. Each Q factor is that which, 

65 bas d on experimental data from a wide range of Images, would produce the desired compression if used 
In plac of the trial array of quantizer values first supplied on the bus 30. The number of bits produced by 
the trial compression thus determines the identification of the required Q factor to be selected, in the over- 
quantizing embodiment, th lookup tabI circuit 54 includes means for providing an offset In the stored 
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lookup tables. Thus, a suitable Input from, for example, a control panel (not shown) may set a selected 
offset of one or more lookup tables, to thereby supply, for example, the over-quantizing factor. Th offset 
corresponds to the expected increase in image complexity. The corresponding identifier signal Is supplied 
to the Q selector 28 at a field or frame rate depending upon whether the data source is field or frame 

5 based. The selector 28 may be a maximum value selector in a simple embodiment. The selector 28 
supplies the resulting Q factor identifier signal to the tape recorder via the bus 32 and also supplies it to the 
Q lookup table circuit 27 at the field or frame rate. The circuit 27, in turn, supplies the individual quantizer 
values to the quantizer circuit 18' of the chip 51. Given a particular Q factor identifier signal, the Q lookup 
table circuit 27 produces the actual quantizer values of the array which is identified by the Q factor identifier 

10 signal. 

In subsequent generations, as described in FIG. 2, the previous Q estimator circuit 26' also supplies a 
Q factor identifier signal corresponding to the Q factor previously used, to the Q selector 28. To this end, 
the transform coefficients from the DCT circuit 14* are supplied to a histogram counter circuit 46, which 
counts the occurrences of selected coefficients in terms of expected maximum and minimum amplitudes. 

16 As generally known, the histogram counter circuit 46 includes a plurality of counters, each of which is 
clocked in response to the receipt of its respective digital number. The resulting count signals are supplied 
to a peak detection/peak separation estimator circuit 48 which uses combinational logic or lookup tables to 
distinguish the maximum and minimum counts and thus the peaks and valleys of the histogram. To this 
end, the circuit 48 detects, for example, the separation between the peaks and then generates a signal 

20 indicative of the previously used Q factor identified by the peaks. Thus the circuit 48 includes a Q identifier 
which associates a particular Q 'actor with each value of peak separation. The identifier signal is supplied to 
the Q selector 28 which, along with the Q table circuit 27. supply the quantizer values to the quantizer 
circuit 18* via the bus 25, as previously described. 

As discussed above, in situations where the previous Q factor is not availal^e explicitly such as in 

25 second or subsequent generations wherein the over-quantizing factor selection technique is being applied, 
the Q factor is estimated from histograms of unquantized transform coefficients. In order for the described 
t chnique to determine the precise Q factor used, the Q factors must be drawn from a discreet set of Q 
factors which differ sufficiently for an unambiguous determination to be made. Furthermore, the Q factor 
should be uniquely determined from an estimate of relatively few quantizer values in the Q factor array. If 

30 some group of quantizer values in each array have the same value, then the precision of the technique is 
inr>proved by including amplitudes from all the corresponding coefficients in a single histogram. For a DCT 
based system, for example, the lowest 3 or 5 AC coefficients may all be multiplied by the same quantizer 
value in any given array. The value of this quantizer value should differ from array to array, and will 
uniquely identify the array and hence distinguish all the quantizer values in the array. 

35 In a first algorithm, for a known set of Q factors, the histogram accumulation may be limited to selected 
discre t amplitudes which represent selected known minima and maxima which could result from the set. 
Simplistically the largest maximum or smallest minimum should uniquely identify a particular Q factor. In 
practice some logical function of several maxima and minima will give a more reliable estimate. As an 
xample, each quantizer maybe represented by p histogram counters at expected maxima and expected 

40 minima. An estimator such as previous Q estimator 26 then identifies a particular Q factor only if its 
maximum counters are among the r highest counts and its minimum are among the m lowest. The choice 
of p, r and m depends on the set of Q factors to be discriminated and on the experimentally determined 
histogram variability for a particular application. 

FIG. 4 illustrates a histogram of measured outputs of the first five AC coefficients generated in a 

45 computer simulation, and further augments the description 2ibove of the previous Q estimator circuits 26, 
26*. The curves of the histogram depict the coefficient count versus amplitude of the original picture or 
image after the image data is transformed. In particular and as labeled In FIG. 4, the curves represent the 
original image data with no quantization, and the image data during first generations in which data 
compr ssions are performed using dividing quantizer values of 20 and 60. drawn from Q factors labeled for 

50 convenience Q20 and Q60. Thus, the histogram courrter circuit 46 of FIG. 3 counts the numtser of 
occurrences of selected coefficients as represented by the Q20 and Q60 curves in FIG. 4. The peak 
detection/peak separation estimator circuit 48 then distinguishes the peaks and/or valleys of th curves in 
the histogram, whereby the quantizing factor value used in th previous compression process is deter- 
mined. That is, the separation between peaks in a histogram Is equal to the dividing quantizer used. Several 

55 different algorithms may be used to measure the separation, as discussed in RGs. 3 and 5. 

In the general technique where over-quantizing Q factors are selected, the Q selector 28 supplies the 
over-quantizing factor value to the quantizer circuit 18' of chip 51. Then as described previously in FIG. 2, 
in subsequent generations after the first, the Q selector 28 first compares the required and previous Q 
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factor values from circuits 24\ 26\ respectively. If the required Q factor is smaller than the previous Q 
factor used the last generation, then th Q selector 28 supplies the previous Q factor to the quantizer circuit 
18'. That is. the value of the previously used larger Q factor from circuit 26' is used, as was used in the first 
generation. The same procedure is followed in subsequent generations, wherein the same preselected over- 

5 quantizing factor preferably is used throughout all the following generations. 

FIG. 5 illustrates an alternative embodiment of the previous Q estimator circuit 26' of FIG. 3, wherein an 
auto con-elation. Fourier, or similar transform is applied to the histogram. In the corresponding algorithm, the 
fundamental frequency derived in the resulting output provides the period or peak separation directly. To 
this end, the transform coefficients are supplied from the DCT circuit 14' to a histogram counter circuit 53 

10 similar to the circuit 46 of FIG. 3 In that the counters therein count the occurrences of selected coefficients 
in terms of their amplitudes. The resulting count signals are supplied to a generally conventional auto 
correlator circuit 55 which provides the fundamental frequency indicative of tiie peak separation directly. 
The resulting signal is supplied to a first order peak estimator circuit 57, which scans the auto correlator 
circuit 55 output for the largest non-zero order peak. Thus the estimator circuit 57 scans from a zero offset 

75 Upwards while looking for a first minimum and then continues to scan until it finds a first maximum. Being 
dependent on many histogram values, this peak may be accurately determined. The circuit 57 supplies the 
previously used Q factor identifier signal to the Q selector 28. 

It is to be understood that the previous Q estimator 26 and Q selector 28 of FIGs. 2, 3 are not required 
in the event that the Invention technique of using a non-degenerative set of quantizing factors is used. That 

20 is, since a different Q factor is selected every generation without an increase in noise, there is no need to 
know the Q factor previously used, only the required Q factor. 

If the Q factor Is not changed during multiple generations of image data, it is acceptable in the 
quantizing process to employ a normal rounding algorithm of adding a constant 0.5 followed by truncation. 
However, if . the Q factor Is changed prior to a subsequent generation, then It Is desirable, in accordance 

25 with the invention, to modify or "dither" the rounding algoritiim to add a pseudo random number In tiie 
range 0...%'<instead of the constant 0.5) to all coefficient numbers greater than a preselected threshold. The 
preferred threshold generally is in the range of ± 1 to 2. Information sufficient to allow the re-creation of tiie 
sequence -x)f pseudo random numbers is fon/varded along with tiie data. The regenerated sequence is 
effectively-isubtracted when the image data is decompressed. 

30 The use of dither rounding is not applied in certain embodiments of \he invention, such as when the Q 
factor Is sialected from the finite non-degenerative set of Q factors of previous mention. That is, dither 
rounding preferably is applied with the embodiment which uses over-quantizing factors, and then only when 
the Q factor is changed in a subsequent generation after tiie first generation. The ditiier rounding technique 
has advantages particularly when no attempt is made to use precisely the previous Q factor. 

35 To furttier illustrate ttie technique of dither rounding. FIG. 6 depicts in functional block diagram, a 
typical rounding technique of adding a constant 0.5 to the coefficient values, and then truncating tiie 
fi-actional part of the resulting summations. To simplify the illustration, the coefficients are shown separated 
into an integer part and a fraction part, and the parts are supplied to an adder 60. A second input of a 
constant 0.5 also is supplied to the adder 60, which adds the 0.5 to the coefficient values. The results of the 

40 rounding process are provided by the integer part of the summation, with the fraction part of tiie summation 
being truncated to provide the rounding. 

In accordance with the dither rounding technique of the invention, in FIG, 7 the coefficients again are 
depicted as integer and fraction parts, with the coefficient values supplied to an adder 62. A random 
number generator 64. which is initialized by an initialize signal input on a line 61, supplies a pseudo random 

45 number sequence to a second input of the adder 62 via a switch 63. A second contact of the switch 63 is 
coupled to a constant 0.5 signal source. A selector 65 which is responsive to a tiireshold Input, is coupled 
to receive the coefficients generated by the DCT circuit. In a situation where the coefficient is less than the 
threshold, the selector 65 switches the switch to the constant 0.5 input and the conventional rounding 
technique is applied to the incoming coefficient. In accordance witii the Invention, when the coefficient is 

so larger than the threshold, the selector 65 couples the psuedo random number generator 64 to the adder 62 
via the switch 63. In the latter situation, the adder 62 adds the successive pseudo random numbers to 
respective coefficients, and supplies tiie integer parts of the summations to the ncoder. The fraction parts 
of the summations are truncated, that is. are discard d. Optionally, the error Introduced may be minimized 
by subtracting the pseudo random numbers. The Inltializ signal Is forwarded along with the data, whereby 

55 the noise added due to the pseudo random numbers is partially subtracted from the signal in th 
decompression process. That is. tiie initialize signal identifies tiie start of tiie pseudo random sequence 
whereby it may be used In the decompression process. A certain amount of noise remains in the signal du 
to the information lost In the truncation process. As mentioned, th selector 65 switch s in the dither 
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rounding portion of the circuit only for coefficient values above the thr shold which may be of the order of, 
for example. ±1 through ±3. The frequency spectrum of the pseudo random number sequence generally is 
selected to minimize the visibility of the residual noise, for example, may be evenly distributed or may b 
weighted towards higher frequencies. 
5 FIG. 8 depicts one example of dither rounding recovery in the decompression process. The integers 

corresponding to the coefficients are supplied to a selector 67, to a first contact of a switch 68 and to a 
positive input of an adder/subtractor 66. The selector 67 also is supplied with a threshold input of, for 
example, ±1 through ±3. A constant 0.5 input signal is supplied to a second positive Input of the 
adder/subtractor 66. A random number generator 64 receives the initialize signal forwarded from the 

10 compression process via the line 61, and supplies the same pseudo random number sequence to a 
negative input of the adder/subtractor 66. The adder/subtractor 66 provides an output of the combined 
integer and fraction parts corresponding to the transform coefficients, to a second input of the switch 68. 
The common output of the switch 68 supplies the coefficients to the inverse transform circuit 42 as in RQ. 
2. Thus, the selector 67 provides the means for adaptively switching the switch 68 to the pseudo random 

16 number generator, that is. to the adder/subtractor 66 output when the coefficient value exceeds the 
threshold value, and vice versa. The coefficients are either rounded in accordance with a typical constant 
0.5 rounding procedure, or are rounded in accordance with the dither rounding procedure of the invention, 
as determined by the threshold. It is to be noticed that the dither rounding is applied uniquely directly to the 
transform coefficients supplied by the dequantizer 40. 

20 It is to be understood that any procedure which is mathematically equivalent to the above dither 
rounding technique, is equally applicaule. For example, an appropriate pseudo random number sequence in 
the range -0.5 to +0.5 is equivalent to the original sequence of 0...1.0. 

The importance of the strategy of not changing the Q factor with each generation is emphasized in RG. 
9, which qualitatively illustrates the relationships between the invention embodiments of selecting an over- 

25 quantizing Q factor, of selecting a Q factor from the non-degenerative set of Q factors, and of dither 
rounding in the event an over-quantizing factor must be changed in a subsequent generation of multi- 
generations. The relationships apply in situations wherein image complexity is increased or decreased by 
data layering during a generation. The curves illustrate the relative root mean squared (RMS) errors for an 
image of varying complexity when applying the invention embodiments, and depict the RMS errors for a 

30 first and several subsequent generations, given specific Q factors chosen to provide a constant compres- 
sion with and without the dither process of previous description. The 'with dither" and "no dither" curves 
70,72 and 74,76, respectively, (both pairs of solid line and short dash curves) apply to prior art techniques, 
as well as to the invention over-quantizing technique when the same over-quantizing value is changed in a 
subsequent generation of a multi-generation process. Note that the units used for RMS errors are qualitative 

35 and ar used herein only as a means for comparing the decrease in RMS errors when using the invention 
techniques. It can be seen from the "first generation" curve 78 (solid line curve) that a significantly small 
change in RMS error results with increased or decreased complexity of the image, under conditions where 
the inr>age data is being processed through a single generation, and an optimum Q factor is selected for 
each compression/decompression first generation. An optimum Q factor is that Q factor which precisely fits 

40 the data compressed thereby into the allotted data recording space or data rate, as is commonly done in 
prior art compression systems. The "over-compression" curve 80 (short dash dot curve) also illustrates the 
embodiment of over-quantizing the image data on the first generation, and then maintaining the same over- 
quantizing factor for subsequent generations in which layering may or may not be performed. 

For example, assuming a Q factor which provides a compression ratio of 3:1 for the given image 

45 complexity, the RMS error for a first generation using an optimum selection of the O factor is illustrated 
herein by curve 78 as about 1.7. In a second generation during which image complexity is increased due to 
layering. If a larger Q factor is used to provide the same 3:1 compression ratio, the RMS error will increase 
in accordance with the "no dither" curve 76 to about 2.8. However, if the larger (over-quantizing) Q factor 
had been selected for the first generation with RMS noise of about 2.1 , and had been used again in tiie 

50 second generation, the RMS error will increase in accordarrce with the "over compression" curve 80 and 
would still remain at 2.1. That is, there is no increase in noise over that incurred in the first generation. 
Similarly, after five generations, with the image complexity increasing each generation due to layering, the 
RMS rror generated by using a new, optimum Q factor each generation (as in the prior art) would b about 
6.0 as depicted by the "no dither" curve 76. On the other hand, if the Q factor used in the fifth generation is 

55 still the same over-quantizing Q factor used in the first generation, and if the same over-quantizing Q factor 
has been used in the s cond through fourth generations, then the RMS error is still only about 2.1 as 
depicted by the over-quantizing curve 80. This is a marked improvement on the RMS error of 6.0 generated 
by the prior art system of selecting new. optimum Q factors for each g n ration. 
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In the event that an over-quantizing Q factor is selected and the complexity of the layer d image after a 
few g nerations exceeds the capabilities of the over-quantizing Q factor, then the excessive RMS errors that 
would be generated may be sharply reduced by applying the dither rounding technique of the Invention. To 
illustrate, changing the Q factors through the generations up to the fifth generation without using the over- 

5 quantizing technique or the dither rounding technique (see curve 76) would generate an RMS error of 6.0. 
On the other hand, applying the dither rounding technique reduces the RMS error to about 2.65 as derived 
from the "with dither" curve 72 of FIG. 9. 

As Illustrated by the curve 82 labeled "non-degenerative Q factors" (dashed heavy line), consistently 
low RMS errors are experienced in multi-generations of image data compression/decompression with 

10 layering, if the Q factor values are selected from the pre-defined finite non-degenerative sets of Q factors of 
previous mention. In such technique, a new and different Q factor may be selected for each subsequent 
generation of compression/decompression If. and only if. each Q factor is selected from the non- 
degenerative set. Thus, for example, if all quantizer values in the first generation Q factor array are 1, and if 
layering Increases the complexity of the Image data, then an effective Q factor for the second generation 

75 may be selected by changing some of the corresponding quantizer values in the subsequent an-ay to 3 
and/or 9. The numbers selected are commensurate with, the added complexity of the image due to the 
layering process. Subsequent generations may utilize arrays wherein selected corresponding quantizer 
values are increased to 3 or 9 or even 27. That is, in a preferred embodiment, the corresponding linear 
quantizer values in successive arrays have a preferred numerical relationship of a ratio of the order of three. 

20 Thus the corresponding quantizer values of a non-degenerative set of arrays may be selected as a 
sequence 0.5, 1.5, 4.5, etc. or 2,6. 18. etc., or any other usable sequence having a numerical relationship 
between corresponding quantizers of successive arrays of the order of three. 

In this latter non-degenerative Q factor embodiment, the Q factors may be said to be "over-quantizing" 
values in ithat they generally compress the Image data sufficientiy to allow the compressed data to readily 

25 fit into the desired data block spaces. That is. the non-degenerative set of Q factors generally do not 
precisely frt the compressed data into a given space. In time or block length. Thus as depicted by the curve 
82 in nGr9, the RMS error generated in the first generation mentioned above, using a corresponding Q 
factor (which is taken from a non-degenerative set of Q factors), is about 1.7. A second generation after 
layering has been performed and using a Q factor from the non-degenerative set. in which some of the 

30 quantizer -values of the array are three times larger, provides an RMS error of about 1 .9. and in the fifth 
generation?an RMS error of about 2.25 is experienced. This RMS error also clearly Is preferable to the error 
of 6.0 generated witfi the conventional method of changing Q factors each generation without ditiier 
rounding (curve 76). or the 2.65 error generated when further using dither rounding (curve 72). 

As depicted by comparing the first generation curve 78 with the short dash curves 70. 74 labeled "with 

35 dither" and "no ditiier", respectively. It also is preferable to over-quantize and then maintain the same Q 
factor in a particular multi-generation operation, even when the complexity of the image is decreased after a 
first generation. As may be seen from the curve 74, the use of a smaller Q factor with each generation of 
less complexity, without using the dither rounding process, causes a significant increase in RMS en-or. Use 
of the dither rounding technique lessens the RMS error as shown by curve 70. However, it is preferable to 

40 maintain the same Q factor through the generations of decreasing image complexity, unless there is a 
significant decrease in image complexity. If there Is a large decrease In complexity. (e.g., a factor of five) it 
Is more practical to change the Q factor accordingly, to Improve the picture quality. This is particulariy true, 
since the short dash curves 70. 74 curve downwardly to meet the curve 78 if they are plotted further to the 
left of the scale shown in FIG. 9. 

45 However, it is even more preferable to use Q factors of the non-degenerative set during each of the 
generations, since tiien it is not necessary to determine the Q factor used in a previous generation of 
compression. Neither is It necessary to use the dither rounding process. However, there is a compromise 
made in picture resolution due to the larger steps between the non-degenerative quantizer values in 
successive arrays. 

50 Thus, it may be seen that, if successive generations of images increase in complexity, requiring an 
eff ctlve increase In compression ratio, a lower RMS error results by using either of the two techniques of 
th invention for selecting Q factors. In the first technique, the first gen ration is over-compress d and th n 
the same quantizing factor is held constant for no furttier degradation in the Image quality. It also Is 
preferable to hold the Q factor constant ven when successive gen rations would allow an ffectively lower 

55 compr ssion ratio. In the second techniqu . a Q factor is chosen from the predefined non-degenerativ set 
of Q factors whose corresponding quantizer values have the special numerical relationship to each other, 
whereby a lower RMS error results even though a diff rent Q factor may be sel cted for every generation of 
compression. 
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Concerning the second technique, criteria for selecting a non-degenerative set of quantizing factors are 
as follows. First, if quantization is increased in a particular generation, tiien the quantizer transfer function 
output = F (input), for each of the frequency components, must not have threshold values which are close 
to reconstruction values from the previous generation quantizer transfer function. In the absence of such a 

5 condition, reconstructed values which are spread slightly by the transform and other rounding processes, 
would split into two ranges, adding errors. Second, the reconstruction values must minimize errors for both 
a uniform distribution (first generation) and for values clustered around the reconstruction values of the 
previous generation. This implies that reconstruction values must lie approximately half way between 
threshold values, and must also be substantially a subset of the reconstruction values of the finer quantizer. 

TO Third, the reconstruction values preferably should also include the value zero to provide compression using 
run length coding. If there Is to be freedom to choose any Q factor from the set at any generation, then the 
relationship of the above criteria should hold between all corresponding quantizer values in the set of 
arrays. 

Examples of three non-degenerative linear quantizing transfer functions which meet the above criteria 
75 and which exemplify progressively coarser linear quantizing values, are as follows. As may be seen, 
reconstruction values are selected half way between threshold values, but clearly there are a range of 
values about the half way value which may be used as well. Likewise, a subset can have a range of values 
which effectively may be used, as contemplated by the invention. 



20 

F(a) quantizing threshold ±0.5 ±1.5 ±2.5 ±3.5 ±4.5 
q=l reconstruction value 0 ±1 ±2 ±3 ±4 ±5 



25 



30 



40 



45 



50 



F(b) quantizing threshold ±1.5 ±4.5 ±7.5 ±10.5 ±13.5 

q=3 reconstruction value 0 ±3 ±6 ±9 ±12 ±15 

F(c) quantizing threshold ±4.5 ±13.5 ±22.5 ±31.5 ±40.5 

q=9 reconstruction value 0 ±9 ±18 ±27 ±36 ±45 



Examples of threie non-degeneirative non-linear quantizing transfer functions which have closer ratios 
than the ratio of 3:1 exemplified in the linear functions illustrated above, also may be constructed which 
meet the above first, second and third criteria. It is to be noticed however that the non-linear quantizing 
35 transfer functions do not have to comply with the condition of having a numerical relationship of the order of 
three between corresponding values in different arrays. The following series of threshold values is one 
example of acceptable progressively coarser non-linear quantizing values. Reconstruction values again are 
sel cted half way between threshold values, but may use a range ot values. 



F(a) quantizing threshold ±0.5 ±1.5 ±2.5 ±3.5 ±4.5 

q=l reconstruction value 0 ±1 ±2 ±3 ±4 ±5 

F(b) quantizing threshold ±1.5 ±2.5 ±5.5 ±6.5 ±9.5 

q=2 reconstruction value 0 ±2 ±4 ±6 ±8 " ±10 

F(c) quantizing threshold ±2.5 ±5.5 ±10.5 ±13.5 ±18.5 

q=4 reconstruction value 0 ±4 ±8 ±12 ±16 ±20 



This set has the advantage of smaller average ratios between an^ays of tiie set. but th threshold 
intervals are not constant. Implementation would be more complex and would be inconsistent with the JPEG 
specification of pr vious mention. 
55 A simpler technique for obtaining linear non-degenerative Q factors with individual quantizer values, 
may be derived from the relationship q valu = K*(3**n), where K is a constant for any one transform 
coefficient across the set of Q factors, and n is any positive int ger including zero. This equation may b 
used, for example, to generate the exemplary sequence 1 ,3,9,27, for K = 1 . Normal rounding is assumed. If 
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it is desired, for psychophysical reasons, to maintain particular ratios between quantizer values In an array, 
then n must be a constant for each array and K Is selected for the psychophysical reasons, resulting in Q 
factors which grow by a factor of th order of three from array to array. This normally would not allow 
sufficient resolution in selecting a Q factor. If n is allowed to vary over the array, elements, then the effective 

5 average Q factor may be changed in smaller steps but there would be abrupt changes in the quantizer 
value for a particular transform coefficient from one" quantizer array to another. 

Thus, as depicted in FIG. 9, there is a negligible multi-generation penalty in noise for an increase in 
quantization by a factor of the order of three, as, when using Q factors from the linear non-degenerative set 
of arrays. There is a slightly increased penalty for choosing Q factors Intermediate the factor of approxi- 

10 mately three, as shown by the "non-degenerative" curve 82 for the second through fourth generations. It is 
of interest to note that the "non-degenerative" curve 82 starts at the first generation with the samo RMS 
error of 1.7 as shown by the first generation compression process. However, the "non-degenerative* curve 
82 generates the same RMS value as does the "first generation" curve 78 at a quantizer value of the order 
of three times the first generation quantizer value. As previously discussed, three is the pretended ratio of 

75 the invention embodiment which uses the linear non-degenerative set of Q factors. 

By way of further illustration, there follows an example of a set of "non-degenerative" arrays, wherein 
the quantizer values q have been selected using the formula of previous mention. To facilitate the 
description, the base table and the arrays Q1 through Q4 have only a 4 by 4 matrix, rather than the 8x8 
matrix of previous discussion. Also, only four arrays are depicted although in practice, dozens or even 

20 hundreds of arrays are used. The base table provides the value of K for each frequency coefficient, which 
values may be based on psychophysical tosts. In the subsequent arrays, a change In n within an array 
provides the associated change in the corresponding quantizer values from array to array, allowing smaller 
steps in the increasing quantizer values in the arrays. 

25 
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The Q factor may be selected from any member of this s t at any generation without incurring a multi- 
generation p nalty in noise. It may be s n In FIG., 9 that most of th set r suits In RMS errors which are 
only slightiy worse than tor the default weighting used in the earii r simulations with variabi Q factor. In 
55 any particular application, the slightly higher RMS rror of using the nor>-degenerative set of Q factors. Is a 
trad off for a simpler implementation which does not require the previous Q estimator circuit 26. 26* or the 
Q selector 28, nor the risk of selecting an inadequate margin as in the technique which sel cts an over- 
quantizing Q factor at the first generation compr ssion. 
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Claims 

1. Am thod of selecting quantizing factors which limits the quantizing noise introduced during a 
corresponding data quantizing and dequantizing process when performing multi-generations of data 
quantizing and dequantizing, comprising the step of determining quantizing factors for first and 
subsequent generations which limit the degradation in the quality of the data typically caused by 
variations in the data being introduced In subsequent generations to substantially the degradation 
incurred in the quantizing and dequantizing process in the first generation. 

2. A method according to claim 1, wherein the step of determining includes the steps of estimating an 
optimum quantizing factor which compresses the data sufficiently to fit the data into an allotted data 
space; selecting an over-quantizing factor which is larger than said optimum quantizing factor to 
substantially over-compress the data such that the data does not fill the allotted data space; and using 
the same larger over-quantizing factor in subsequent compression processes during the corresponding 
successive multi-generations of data quantizing and dequantizing. 

3. A method according to claim 2, wherein the data represent an image and the complexity of the image 
data Is changed in selected generations, wherein the step of selecting includes providing excess 
compression by selecting an over-quantizing factor as a function of the expected cumulative change in 
image data complexity performed in subsequent generations. 

4- A method according to claim 3, including supplying a trial array of quantizer values; detenmlning 
whether the trial array of quantizer values fits the image data into the allotted data space: performing 
any necessary iterations on the quantizer values until the image data fits into the allotted data space; 
identifying said over-quantizing factor which substantially over-compresses the image data- m resporise 
to said iterations; selecting an array of quantizer values corresponding to the over-quantizing factors 
which over-compresses the image data; and quantizing the image data in response to the selected 
array of quantizer values which over-compress the image data. 

5. A method according to claim 2. including the steps of transforrhing the data into selected transform 
coefficients prior to over-compressing the data; changing the larger over-quantizing factor in one of the 
successive multi-generations of data processing; and applying a pseudo random number sequence to 
selected transform coefficients which exceed a selected threshold, to randomly round off the coeffi- 
cients. 

6. A method according to claim 5, including the step of generating the pseudo random number sequence 
within a range of 0 to 1.0 and with a pre-selected energy spectrum, for use in the step of applying. 

7. A method according to claim 2, wherein a generation subsequent to a first generation is to be 
compressed and said over-quantizing factor is not known, including the steps of transforming the data 
into respective transform coefficients prior to compressing the data; generating a histogram of selected 
coefficients of the respective transform coefficients; and detecting the peaks or valleys of the histogram 
to determine the quantizing factor used previously. 

8. A method according to claim 1 , wherein the step of determining includes the steps of selecting a first 
quantizing factor which would just fit the compressed data into the allotted data space; selecting a 
s cond quantizing factor which is larger than the first quantizing factor; compressing the data in 
response to the second quantizing factor; and using the same larger second quantizing factor in 
subsequent compression processes performed during the corresponding successive multi-generations 
of data quantizing and dequantizing. 

9. A method according to claim 1 , wherein the step of determining includes the steps of providing a finite 
non-degenerativ set of quantizing factors; selecting a quantizing factor from said non-d^enerativ set 
which provid s sufticlent compression to fit the compress d data into the allotted data space; and 
repeating the step of selecting for each subsequent multi-generation of data processing. 

10- A method according to claim 9, wherein the data represents an cage and the step of providing Includes 
providing a set of quantizing factors corresponding to multiple arrays of quantiz r values, wherein 
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corresponding quantizer values in successiv arrays have a predetermined numerical relationship. 

11. A method according to claim 10. wherein the numerical relationship is of the order of three and the 
non-degenerative set of quantizing factors are linear. 

5 

12. A method according to claim 11, wherein the image data are in the form of transform coefficients, 
including the step of deriving the linear non-degenerative set of quantizing factors from the relationship 
q value « IC (3**n), where K is a constant for any one transform coefficient across the set of quantizing 
factors, and n is any positive integer including zero. 

10 

ia A method according to claim 10, wherein the quantizing factors are an approximation of the non- 
degenerative set of quantizing factors. 

14. A method according to claim 10, whereiri the non-degenerative set of quantizing factors are non-linear 
75 and the numerical relationship is less than on the order of three. 

1& A method according to claim 10, including storing a plurality of lookup tables corresponding to the non- 
degenerative multiple arrays of quantizer values; and selecting the lookup table which properly 
compresses the image data to readily fit the data into the allotted data space. 

20 

16. A method according to claim 10. further including supplying a trial array of quantizer values; 
determining whether the trial array of quantizer values fits the image data into the allotted data space; 
performing any necessary iterations on the quantizer values until the image data fits into the allotted 
data space; identifying a quantizing factor from said non-degenerative set which provides sufficient 

25 compression to provide said image data fit; selecting an.anray of quantizer values from said non- 
degenerative set which corresponds to said quantizing factor; and quantizing the image data in 
response to the selected array of quantizer values. 

17. A method according to claim 1, including the steps of transforming the data into selected arrays of 
30 transform values; providing a plurality of arrays of quantizer values wherein each anray has a quantizing 

factor :iommensurate with an average of the quantizer values; selecting a quantizing factor from a 
plurality of lookup tables which provides sufficient compression to fit the data, after compression, into 
the allotted data space; quantizing the arrays of transform values in response to the selected quantizing 
factor; and repeating the above steps for subsequent data compressed during each of said multi- 
35 generations. 

ia A method according to claim 17, wherein the compressed data Is decompressed in a decompression 
process, Including the steps of recovering the compressed data along with a signal identifying the 
quantizing factors used in the compression process; storing a plurality of lookup tables corresponding 
40 to the lookup tables used in the compression process; and decompressing the compressed data in 
response to a lookup table selected by the identifying signal. 

ia A system for quantizing and dequantizing image data, including apparatus for selecting quantizing 
factors which limit the amount of distortion incurred by the image data In subsequent generations due 
45 to variations of the image data being introduced during at least some of subsequent multi-generations 
of quantizing and dequantizing, said apparatus being characterised by means for selecting quantizing 
factors which limit the degradation in image quality by variations in the image data being introduced in 
subsequent generations to substantially the degradation incurred in the first generation. 

so 20. Apparatus according to claim 29, for compressing the image data into an allotted data space, means for 
transforming the image into selected arrays of transform values; means receiving the transform values 
for selecting an over-quantizing factor which over-compresses the Image data such that th data does 
not fill the allotted data spaces; and means r c iving th selected anrays of transform values for 
quantizing the transform values In r sponse to the over-quantizing factor, to provide the over- 

55 compressed image data; wherein said quantizing means applies the same over-quantizing factor to 
transform valu s in said successive multi-generations. 

21. Apparatus according to claim 19, for compressing the image data into an allotted data space, furth r 

19 

aOi <EP 0S0857aA2 I > 



EP 0 509 576 A2 



comprising means for transforming the image data into selected arrays of transform values; m ans 
receiving the transform values for estimating a quantizing factor for properly fitting the data when 
compressed into the allotted data space; means for providing a predetermined finite non-degenerative 
set of quantizing factors in the form of arrays of quantizer values; means storing the arrays of quantizer 
values for supplying an array commensurate with the estimated quantizing factor in response to the 
estimating means; and means for compressing an array of transform values in response to a respective 
array of quantizer values. 

22. Apparatus for selecting quantizing factors for compressing image data into allotted data spaces through 
successive multi-generations of image data processing during which the complexity of the image data 
Is changed, comprising means for varying the complexity ^ the image data in at least one of the multi- 
generations; means for transforming the Image data into selected arrays of transform coefficients in 
each of the multi-generations; means receiving the transform coefficients for selecting quantizing 
factors which limit the degradation incurred by the image data in the successive multi -generations to 
the degradation inherent in the compression process during the first generation, while providing 
sufficient compression to fit tiie compressed data into the allotted data spaces in each of the multi- 
generations; and means receiving the selected arrays of transform coefficients for quantizing the 
transform coefficients of each of the multi-generations in response to the respective selected quantizing 
factor. 

23- Apparatus according to claim 22, wherein the selecting means provides an over-quantizing facior which 
substantially over-compresses the image data such that the data does not fill an allotted data space, 
and wherein the selecting means further provides the same over-quantizing factor through the 
successive multi-generations of image data processing. 

24- Apparatus according to claim 23. wherein the selecting means includes means for providing a trial array 
of quantizer values which correspond to a mid-range quantizing factor for an image of average image 
complexity; means for storing a preselected number of arrays of selectively increasing quantizer values; 
and means responsive to the trial array for deriving said over-quantizing factor in the form of one of 
said stored arrays of quantizer values. 

25. Apparatus according to claim 23. including means for producing a histogram of selected arrays of the 
transform coefficients; and means for detecting the peaks or valleys of the histogram to determine a 
quantizing factor used In a previous generation. 

26. Apparatus according to claim 23, wherein the over-quantizing factor is changed to another quantizing 
factor, including means for applying a psuedo random number sequence to the arrays of transform 
coefficients which exceed a selected tiireshold. to randomly round off the coefficients. 

27. Apparatus according to claim 22. wherein the selecting means includes means for providing a finite 
non-degenerative set of quantizing factors; and means for selecting a quantizing factor from the non- 
degenerative set which provides sufficient compression to fit the compressed image data into an 
allotted data space of a respective generation; wherein said selecting means thereafter selects a 
quantizing factor from the non-degenerative set in response to the change in complexity of the image 
data in each of the successive multi-generations. 

2& Apparatus for rounding a transfomn coefficient in a compression process, comprising means for 
generating a pseudo random number sequence; means for adding the pseudo random number 
sequence to the transform coefficient; and means for truncating any fractional part of the summation to 
leave only an integer part as the rounded transform coefficient. 

29. Apparatus according to claim 28. including means for providing a preselected thr shold; wh r in the 
adding m ans adds the pseudo random number sequence to transform coefficients which are gr ater 
than the preselected threshold. 

30. Apparatus for determining a quantizing factor used In a previous generation of image data compression, 
comprising means for transforming the image data into corresponding transform values; means 
receiving the transform valu s for determining the number of occurrences of amplitudes of select d 
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transform values; and means responsive to the detemnining means for distinguishing the amplitude 
which as the largest or the smallest number of occurrences indicative of the previous quantizing factors. 

31. Apparatus according to claim 30, wherein the determining means includes counter means for counting 
5 the number of occurrences of the amplitudes of selected transform values; and means for generating a 

histogram of the amplitude occurrences. 
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(») Meth d and apparatus for determining a quantizing factor for processes involving multiple 
compression/decompression of data. 



<§) The invention provides techniques for changing 
the quantization used in multiple generations of data 
quantization such that the errors incurred in subse- 
quent generations are substantially the same as the 
error Incurred In the first generations even though 
the complexity of the data has been changed. In a 
preferred embodiment, quantizing factors are se- 
lected from a preselected finite non-degenerative set 
of quantizing factors provided In the form of arrays 
of a periodic series of Individual quantizer values, 
wherein a special numerical relationship is main- 
tained between corresponding quantizer values in 
successive anrays. A different quantizing factor may 
be selected for each generation of 
compression/decompression as required by chang- 
ing data complexity as when performing a layering 
proc ss during the generations, in another embodi- 
ment, an over-quantizmg factor Is chosen large 
enough to compress th data to a greater extent 



than that required in the first generation, such that 
sufficient compression still is provided in subsequent 
generations even though the same quantizing factor 
is used while the complexity of the data is being 
changed. If for some reason the complexity of the 
data changes faster than expected, it is necessary to 
change the quantizing factor to fit the data into the 
allotted space. To moderate the associated increase 
in noise, the invention technique incudes, a dither 
rounding process wherein a psuedo random numl3er 
sequence in the range of 0...1.0 is selectively added 
as determined by a threshold. The invention also 
includes estimating a quantizing factor applied in a 
previous generation of image recording If this in- 
formation Is not available explicitly, by distinguishing 
the peaks and/or valleys of histogram. The am- 
plitudes of the peaks and/or valleys represent the 
number of counts of the respective values of fre- 
quency coefficients to be quantized. 
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